Many-Class Few-Shot Learning on Multi-Granularity Class Hierarchy
نویسندگان
چکیده
We study many-class few-shot (MCFS) problem in both supervised learning and meta-learning settings. Compared to the well-studied many-shot few-class problems, MCFS commonly occurs practical applications but has been rarely studied previous literature. It brings new challenges of distinguishing between many classes given only a few training samples per class. In this paper, we leverage class hierarchy as prior knowledge train coarse-to-fine classifier that can produce accurate predictions for The propose model, "memory-augmented hierarchical-classification network (MahiNet)", performs classification where each coarse cover multiple fine classes. Since it is challenging directly distinguish variety data class, MahiNet starts from over coarse-classes with more whose labels are much cheaper obtain. reduces searching range thus alleviates "many classes". On architecture, firstly deploys convolutional neural (CNN) extract features. then integrates memory-augmented attention module multi-layer perceptron (MLP) together probabilities While MLP extends linear classifier, KNN targeting "few-shot" problem. design several strategies meta-learning. addition, two novel benchmark datasets "mcfsImageNet" "mcfsOmniglot" specially designed experiments, show outperforms state-of-the-art models on problems
منابع مشابه
Efficient Discriminative Learning of Class Hierarchy for Many Class Prediction
Recently the maximum margin criterion has been employed to learn a discriminative class hierarchical model, which shows promising performance for rapid multi-class prediction. Specifically, at each node of this hierarchy, a separating hyperplane is learned to split its associated classes from all of the corresponding training data, leading to a time-consuming training process in computer vision...
متن کاملTransductive Multi-class and Multi-label Zero-shot Learning
Recently, zero-shot learning (ZSL) has received increasing interest. The key idea underpinning existing ZSL approaches is to exploit knowledge transfer via an intermediate-level semantic representation which is assumed to be shared between the auxiliary/source dataset and the target/test dataset and re-used as a bridge between the source and target domains for knowledge transfer. The semantic r...
متن کاملMax-Margin Zero-Shot Learning for Multi-class Classification
Due to the dramatic expanse of data categories and the lack of labeled instances, zero-shot learning, which transfers knowledge from observed classes to recognize unseen classes, has started drawing a lot of attention from the research community. In this paper, we propose a semi-supervised max-margin learning framework that integrates the semisupervised classification problem over observed clas...
متن کاملLarge-Scale Many-Class Learning
A number of tasks, such as large-scale text categorization and word prediction, can benefit from efficient learning and classification when the number of classes (categories), in addition to instances and features, is large, that is, in the thousands and beyond. We investigate learning of sparse category indices to address this challenge. An index is a weighted bipartite graph mapping features ...
متن کاملClass label autoencoder for zero-shot learning
Existing zero-shot learning (ZSL) methods usually learn a projection function between a feature space and a semantic embedding space(text or attribute space) in the training seen classes or testing unseen classes. However, the projection function cannot be used between the feature space and multi-semantic embedding spaces, which have the diversity characteristic for describing the different sem...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: IEEE Transactions on Knowledge and Data Engineering
سال: 2022
ISSN: ['1558-2191', '1041-4347', '2326-3865']
DOI: https://doi.org/10.1109/tkde.2020.3004939